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The Compuier- Based Educational Software 
System (CBESS) is an set of programs de- 
veloped for the Navy Personnel Research and 
Development Center. It consists of 22 pro- 
grams addressing authoring, instructional deliv- 
ery, and instructional management. The pro- 
grams are divided into five groups: 

• Computer-Based Memorization System 
(CBMS) programs (11 programs) 

• Equipment Problem Solving Trainer 
(EPST) programs (4 programs) 

• Language Skills CAI (LSCAI) programs 
(2 programs) 

• Script-Based CAI (SBCAI) programs (3 
programs) 

• Instructional Management (2 programs) 

This report describes the CBESS programs and 
the instructional strategies built into them. 

'This work was supported in pwt until April 1987 by 
the Navy Personnel Research and Development Center 
Contract N002^4-83-C-1759. Since April 1987 this work 
h^s been supported by Darbick Instructional Software 
Systems. 



1 CBMS 

The Computer-Based Memorization System 
(CBMS) is a set of programs designed to help 
students acquire and maintain declarative (fac- 
tual) knowledge. In addition, the programs can 
help students learn to: 

• recognize items from graphics or video 

• recall properties of items 

• recall properties of categories 

• discriminate among items 

• identify items from descriptions 

• select discrimin i,ting questions 

CBMS consists of eight computer-based games, 
a program to browse through CBMS databases, 
a program to compile databases, and a program 
to decompile databases. The games are scored 
to make playing them interesting. In addition, 
a file containing an overlay model of the stu- 
dent's knowledge is built as the student plays 
the games. This file permits the games to adapt 



to a student's evolving knowledge. For exam* 
pie, when data in this file shows that a student 
knows a particular fact, the games stop asking 
questions about it. 

CBMS uses a taxonomic hierarchy^ to organize 
the items being described.^ The CBMS seman* 
tic network supports: 

• multiple inheritance 

• attribution 

• exceptions 

CBMS also permits authors to bind to network 
nodes: 

• pictures 

• alternative answers 

The games display the pictures of items where 
appropriate. They will match a student re- 
sponse against a list of acceptable alternatives 
if it doesn't match the node name. Because the 
alternative answers bcund to a node are used 
only when the node's name is an expected an- 
swer they have only a local effect.^ The alter- 
native answers are not displayed to students. 

^The semantic network used by CBMS is a standard 
knowledge representation 4nd described in many places. 
For example, see the October T986 issue (Vol. 74, No. 
10) of the Proceedings of the IEEE. 

^CBMS differs from standard semantic networks in 
that it does not distinguish between classes, categorized 
with the I$A relation and individuals, normally catego- 
rized with the InstanceOf relation. CBMS only uses 
I$A, 

*The relation SYNONYMSOR permits authors to 
create global alternatives. The answer parser substi* 
tutes global alternatives in its attempts to match student 
answers. 



To simplify the semantic network, sentence gen- 
eration, and search strategies, the facts are lim- 
ited to three part facts, consisting of a subject, 
a relation I and an object. Examples of three 
part facts are: 

"Ronald Reagan** **«a8 elected** president; 
California capital Sacramento; 
abducens inneryates **lateral rectus'* 



1.1 CBMS Games 

In the CBMS games a distinction is made be* 
tween recall and recognition. Usually students 
are first given the opportunity to type (recall) 
the answer. If students are unable to recall it 
they can switch to multiple choice and then 
attempt to recognize the answer in a list of 
possible answers. Students receive lower scores 
for recognition answers than for recall answers. 
Randomization and scoring make the games in- 
teresting and fun. The games provide students 
with the repeated exposure needed to memorize 
facts. 



1.1.1 Concentration 

Concentration's purpose is to reinforce the per- 
ception of relationships among items. The game 
uses a matrix game board in which each row 
and column correspond to items in a selected 
category and thdr attributes. Students choose 
a position on the board and answer a question 
that asks if the corresponding row and column 
items are related. 



1.1.2 Constraint 

Constraint's purpose is to help students learn 
to discriminate among members of a selected 
category. A statement and a list of category 
members are displayed and students mark the 
items in the list for which the statement is true. 



1.1.3 Flashcard 

Flashcard's purpose is to help students recall 
all facts about members of a selected category. 
Flashcard is an electronic version of conven- 
tional study aids based on flash cards. 



1.1.4 Identify 

Identify's purposes are to help students (1) iden- 
tify members of a selected category from short 
descriptions and (2) review facts about the iden- 
tified members. 



1.1.5 Jeopardy 

Jeopardy uses a matrix game board to teach stu- 
dents to identify mcm6er5 of selected categories 
from their complete descriptions. 



1.1.6 Matrix 

Matrix's purpose is to help students learn those 
items in the database that have similar proper- 
ties. Matrix uses a matrix game board in which 



each row corresponds to the subjects of state- 
ments and each column corresponds to the re- 
lation portion of statements. When students 
select a box from the matrix, a question is pre- 
sented asking for the objects that correctly com- 
plete a statement constructed using the row sub- 
ject and the column relation. 

1.1.7 Picture Quiz 

Picture Quiz's purpose is to provide students 
with pT'actice in recognizing objects from pic- 
tures. 

1.1.8 Twenty Questions 

Twenty Questions' purpose is to give students 
practice in selecting and forming discriminat- 
ing questions. Students ask yes/no questions to 
identify an item selected by the game. 

1.2 CBMS Authoring 

There are two parts to authoring a CBMS 
database. The ASCII text file specifying the 
semantic network is created and edited with or- 
dinary text editors. The sequences (pictures) 
associated with nodes are created and edited 
with the sequence editor, se. Sequences may 
include graphics, video, and text. 

In addition to the statements specifying the se- 
mantic network, the text file includes: 

• question templates specifying question 
formats 
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• alternative answer specifications 

• display specification that identify re- 
quences to associate with nodes 

The text file and associated sequence files are 
compiled with the program f romtoxt to create 
the CBMS databases used with the games. The 
program totozt decompiles CBMS databases 
to recreate the original text files. 

1.3 CBMS and Memory 

The design of CBMS was influenced by recent 
experimental and theoretical work on memory. 
John R. An^derson's spreading activation theory 
of memory as described in his book Architec- 
ture of Cognition[2] and other "semantic** mem- 
ory models[23) provide the theoretical basis for 
CBMS. The unproven but plausible hypothesis 
in CBMS is that through repetitive use of the 
games, students may adopt the semantic orga- 
nization that an author or authors have built 
into a database. 

PiroUi and Anderson[18] studied the role of 
practice on fact retrieval. They found that prac- 
tice spaced over many days is more effective in 
terms of the number of required repetitions for 
a given reaction time than extensive practice on 
a few days (see their Figure 3, p. 147). The 
CBMS games use a "two-in-a-row** rule to limit 
the number of repetitions in a single session with 
a game. The two-in-a-row rule stops the presen- 
tation of a particular question once a student 
has answered it correctly twice consecutively in 
a game.^ 

*Thc data of Pirolli and Anderson show that it is 



Authors may specify the minimum number of 
game sessions in which a student may answer a 
question involving a particular fact or item by 
specifying the "Importance** (a small number) 
of the fact or item. Each time a student an- 
swers a question involving a particular item or 
fact correctly, one is subtracted from its Impor- 
tance; each time a student answers a question 
incorrectly, one is added to its Importance. The 
probability that a particular item or fact will ap- 
pear in a question is proportional to its Impor- 
tance. When the Importance of an item or fact 
reaches zero, it no longer appears in questions. 
The two-in-a-row rule keeps the Importance of 
an item or fact from going down more than two 
during any game session. This allov^s an author 
to specify in advance the minimum number of 
practice sessions that will include a particular 
item or fact. For example, if an author initial- 
izes the Importance of an item or fact at 10, the 
students will see questions involving the item or 
fact in at least five (5 = 10/2) separate sessions. 



2 LSCAI 

Language Skills Computer Aided Instruction 
(LSCAI) is designed to help students learn new 
vocabulary by presenting exercises of four to 
nine words. Since LSCAI addresses only vocab- 
ulary acquisition, its name is a misncmer, re- 
tained for historical reasons LSCAI consists of 
two programs: Isstu, the instructional delivery 
program, ajid Isaut, the authoring program. 



most efficient to correctly answer a question just once 
in a game. However, the students with whom we have 
worked, preferred getting the answer correct twice. 
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LsBtu follows generally accepted rules for vo> 
cabulaiy acquisition.^ After the words are intro- 
duced either in a context that permits students 
to deduce the meanings of the words (from- 
context learning) or with key words and defi- 
nitions (keyword learning),^ student knowledge 
of the words is tested and reinforced in the fol- 
lowing activities. 

• Definition Building 

• Hidden Multiple Choice 

• Visible Multiple Choice 

• Antonyms and Synonyms 

• Spelling 

• Definition Matching 

• Labeling 

• Cloze Paragraph 

The activities can be divided into two groups. 

• Individual Word Activities 

• Collective Word Activities 

Students should not do all the activities at once. 
Individual exercises may be specified from the 

^There has been less reported research on vocabulary 
acqui'.ition than on memory. The design of LSCAI was 
influenced more by prescriptions than by experimental 
dat&. Professors Gabe Della-Piana and Ralph Reynolds 
of the College of Education of the University of Utah 
provided the initial prescriptions. 

•'When LSCAI was designed, from-context learning of 
vocabulary words was the accepted method. It is still a 
widely accepted approach[8, 22]. However, recent exper- 
imental work by Dempstcr[7] and McDaniel et al[12, 19] 
has shown that other approaches, particularly keyword 
training, are more efficient. The sequence currently used 
to present the context material can be used without any 
software changes for keyword learning. 



operating system command line. For example, 
to do only the hidden multiple choice and la* 
beling activities for the exercise "climate" in a 
database called "geography," a student would 
enter or an instructor would specify in a course 
fUe: 

Isstu -hi geography climate 

2.1 Individual Word Activities 

The individual word activities concentrate on 
one word at a time. If a sequence of individual 
word activities is specified, for example if the 
five individual word activities are specified, 

Isstu -dhvas geography climate 

all five activities will be presented for one word 
before any activities are presented for the next 
word.^ 



2.1.1 Definition Building 

Students "build" the word's definition by select- 
ing phrases from a menu. If a selected phrase 
is wrong, LSCAI shows the number of the cor- 
rect phrase and puts the correct phrase into the 
definition. The process continues until the defi- 
nition is complete. 

^Presenting all five individual word activities as illus- 
trated in the command is not recommended. Dempster's 
experiments on spacing[7] have shown that it is better to 
''space" the activities for a word. 



Received: 14 
Possible: 14 

Definitions 

1. The standard for 50 years, this 
eyepiece has a strong field curvature, 
small field of view (30 degrees) and 
bad spherical aberration. The 
^epiece is only useful in very slow 
(f/15) telescopes. 

2. This eyepiece is a simplified (and less 
expensive) version of a Erfle. 

3. This is a wide field (65 degree) moderately 

^_ - 8 more below - 

Select definition for ^Symmetric^: Select Quit 



Figure 1: Visible Multiple Choice 
2.1.2 Hidden Multiple Choice 

Students view complete definitions, one at a 
time. They decide whether the displayed def- 
inition is the correct one. Definitions are dis- 
played until either the correct definition for the 
current word is shown or a wrong definition is 
chosen. This activity is similar to the "semantic 
decision task" used by McKeown et al[13). 



2.1.3 Visible Multiple Choice 

Students choose the correct definition for the 
current word from a list of definitions. Figure 1, 
above, shows an example of the Visible Multi- 
ple Choice menu. This activity is similar to the 
multiple choice activity on most vocabulary ex- 
ams. 



2.1-4 Antonyms and Synonyms 

Students identify words that are antonyms, syn- 
onymSf or related words for the word being 
studied from a list that also includes distrac- 
tor words. This activity is skipped if there are 
no associated words. 



2.1.5 Spelling 

Students study a displayed word and press the 
Enter key when they are ready to spell it. The 
word is then erased and students may enter it. 

2.2 Collective Word Activities 

The collective word activities involve most of 
the words in an exercise. 



Matching Students match the words shown 
in one menu with their paraphrased definitions 
shown in another menu. All the words in an 
exercise are displayed. Figure 2, p. 7, shows an 
example of a Matching activity menu. 

Labeling A Sequence containing graphics, 
text, and video associated with exercise words 
is presented. Students enter the names of items 
in answer spaces next to the items. 



Cloze Paragraph Students enter missing 
words in answer spaces to complete one or two 
displayed paragraphs. 



Received: 14 
Possible: 14 



Words 

RKE 

Nagler 

Kellner 

Wide Field 

Orthoscopic 

Erfle 

Huygens 

PIossI 

2 more below 



Definitions 

This is an wide-angle 
(82 degree) eyepiece 
with good correction 
that costs aboat 3 times 
that of a Plosfl. 
The standard for 50 years, 
this eyepiece has a strong 
field curvature, small field 

9 more below 



Match joins the highlighted word with the 
highlighted definition. Unmatch separates 
the highlighted word from any definition. 



Match Unmatch Switch-menu Evaluate 



Figure 2: Matching Activity 



• Paraphrased definition (Matching) 

• Related context Sequence (On Error) 

• Associated words (Antonyms and Synonyms) 

• Confused words (Multiple Choice) 

A word may have several sets of definitions if it 
has more than one meaning. 



2.3.2 Exercise Data 

Entry of exercise data is a form of fill-in-the- 
blank authoring. The components of exercise 
data and their use are listed below. 

• Word list (defines the exercise) 

• Context Sequence (Introduction) 

• Sequence (Labeling) 

• Label data (Labeling) 

• Cloze paragraph (Cloze) 



2.3 LSCAI Authoring 

Although LSCAI uses the same form of semantic 
network as CBMS, a special program, Isaut, is 
used for entering and editing word data, exercise 
data, and Sequences. 



2.4 LSCAI and Vocabulary Acquisi- 
tion 

Vocabulary acquisition is significantly more 
complicated than memorization of facts. For 
example, the answers to the questions 



2.3.1 Word Data 

Entry of word data is a form of fill-in-the-blank 
authoring. The components of word data and 
their use are listed below. 

• From-context definition (Definition Building) 

• Full definition (Multiple Choice) 



Vhat city is the capital of Maine? 

Of which state is Augusta the capital? 

are well defined when compared with the an- 
swers to the following two definition questions. 

Vhat is the capital of a state? 
Vhat serves as the seat of a state 
govenunent? 



These second two questions also show that there 
are two aspects to vocabulary knowledge; the 
knowledge of the meaning of a vord (compre- 
hension) and the converse issue of knowing the 
word that conveys a desired meaning (expres- 
sion). 

2.4.1 Comprehension and LSCAI 

There are several stages in students' knowledge 
of word meanings [6]. 

1. Unrecognized. The word or phVase has not 
been seen before. 

2. Recognized. The word or phrase has been 
seen before but its meaning is unknown. 

3. Knowing in Context. The approximate 
meaning of the word or phrase is known 
only if the word is presented in context. 

4. Definition Selectable. The correct defini- 
tion of a word or phrase can be selected 
from a list of possible definitiops. 

5. Woid Definition Recognizable. The correct 
definition of a word is recognized when it is 
presented by itself. 

6. Word Definition Recall. The correct defini- 
tion of a word can be recalled. 

LSCAI can be used to get students to the fourth 
and fifth stages. The visible n ^♦iple choice 
and matching activities provide w^adents with 
practice in definition selection and the hidden 
multiple choice activity provides students with 



practice in definition recognition. Although the 
multiple choice activities along with the asso- 
ciated word activity prepare students for the 
most common form of vocabulary test, the mul- 
tiple choice test, their use in instruction has 
been criticized[9]. Consequently, they probably 
should be used only in combination with one 
or more of the other activities. For example, 
one way to introduce students to a set of words 
would be to present the context sequence fol- 
lowed by the visible multiple choice activity. 

The contents of the context sequence introduc- 
ing the words and of the related context se- 
quences providing additional information when 
students choose the wrong definitions are con- 
troversial. Many educators believe that stu- 
dents should learn words from context rather 
than be presented with the definition because 
students learn most words from context. How- 
ever, in a series of experiments, the psychol- 
ogists McDaniel and Pressley[ll] have shown 
that both the keyword method and the def- 
inition presentation method are more effec- 
tive the context method. Furthermore, 
they[12] have shown that the long term reten- 
tion of definitions learned with the keyword 
method is the same as the long term retention of 
the definitions learned with the less efficient (it 
takes more trials to meet criterion) from-context 
method. Thus it now appears that the con- 
text sequence and the related context sequences 
should provide the student® with a keyword and 



*McDuuel and Pressley have shown that the keyword 
method is roost effective with low ability students (in 
their test students with verbal SAT scores less than 560); 
it was no more effective t \n the control of presenting 
just the definitions with the high ability students (verbal 
SAT scores greater than 560). 
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keyword illustration that relates the word to its 
definition where possible.^ 

There have been no experiments on vocabu- 
lary acquisition equivalent to Pirolli aad Ander- 
8on*s on memory[18]. However, it seems likely 
that their results would apply to vocabulary ac- 
quisition as well. Working on new vocabulary 
words over a pmod of days is likely to more 
effective than concentrating the work on a sin- 
gle day. Beck et al[3) emphasize the impor- 
tance of providing instruction over a period of 
days (5 in their case). In addition, Dempster^s 
experiments[7] have demonstrated the value of 
"spacing** in a particular lesson. Consequently, 
it appears that LSCAI will be most effective if 
each group of exercise words is presented over 
a period of days, using only one or two of the 
activities each day. 



3. Word Recognizable. The correct word for a 
particular application can be selected from 
a list of possible words. 

4. Word Recall. The correct word for a par- 
ticular application can be recalled. 

LSCAI can be used to get students to the third 
and fourth levels. The labeling and cloze ac- 
tivities require students either to recognize or 
recall words. Specifically, if a list of possible 
words are provided in the labeling and cloze ac- 
tivities, these activities provide students with 
practice in word recognition. If the list of words 
is omitted, the two activities provide students 
with practice in word recall. 

3 EPST 



2.4.2 Ex .ession and LSCAI 

There are several stages to a student's use of a 
woru in written and oral expression. 

1. Word Unknown. The correct word for a 
particular meaning is unknown. 

2. Word Selectable. The correct word for a 
particular meaning (definition) can be se- 
lected from a list of possible words. 

*The keyword must be acousticidly related to the 
word to be defined. An example of a word keyword 
pair[19] is "angler" And "angel." The iUustration is an 
"angel who is fishing." It is often not possible to find an 
appropriate keyword and illustratbn, particularly when 
the word has a precise technical meaning. 



The Equipment Problem Solving Trainer 
(EPST) was design'^d to permit authors with- 
out programming skills to create simulatioiis of 
equipment. The simulations are used to pro- 
vide students with the opportunity to observe 
how pieces of equipment work and to practice 
troubleshooting strategies. EPST was designed 
for practice; it provides no feedback to students 
aside from preventing them from taking dan- 
gerous actions and comparing the cost of their 
solution to the cost of an optimal solution. 

Authoring in EPST is easy. It consists of spec- 
ifying the behavior of individual (prototypical) 
parts and then connecting instances of parts to- 
gether to build equipment. EPST's design was 
oriented toward digital systems; these systems 
are constructed by connecting together "ofF-the- 
sheir parts. EPST supports the development 
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of libraries of prototypical parts. The use of 
libraries has both advantages and drawbacks. 
The primary advantage is that once ? proto- 
t]rpical part and its behavior have been speci- 
fied in an EPST library it can be used in many 
pieces of equipment without any additional ef- 
fort. The primary disadvantage is that a part's 
output cannot depend on the properties of the 
parts lo which it is connected because these are 
unknown until instances of the part are con- 
nected to other parts. This predudes the use 
of EPST for systems where a part's output de- 
pends on the devices to which it is connected. 
For example, EPST cannot be used for analog 

circuits or analog process simulations such as 
PLANT[17].^o 

A part's state is recomputed whenever one of 
its inputs changes. Production rules are used to 
determine the aew state. The rule conditions 
may involve the part's inputs, previous state, 
and error conditions. For each part, state func- 
tions are used to specify its outputs in terms of 
itE inputs, current state, and error conditions. 
The part data is kept in databases containing 
only part information. 

Equipment is specified in separate databases 
containing the connectivity information, equip- 

*®EPST may be used in some analog circuits by adding 
•hidden*" devices, '"daemons,'' that do the necessary com- 
putations. Authors must design and specify the perfor- 
mance of these Msmons.** For example, an electrical 
voltage drop "constraint daemon** might compute the 
current flow through a group of parU from the driv- 
ing voltage(s) and the resistances of the parts. These 
''daemons" depend on the connectivity and subvert the 
original goal of EPST that the parts be independent of 
the connectivity. In addition, •invisible" wires must be 
added to the system to transmit the information needed 
by the "daemons " 



ment specific data (initialization data is usu- 
ally equipment specific), and instances[4] of the 
parts. Each equipment database is bound to the 
database containing the part information be- 
cause the part data is not copied into the equip- 
ment database. The part instances in the equip- 
ment databases contain the dynamical data (in- 
put, output, state, and error values) and data 
identifying the prototypical part in the part 
database. 

EPST consists of four programs: a student pro- 
gram, epstu, an authoring program, epaut, a 
type editing program, eptype, and a problem 
specification program, praut. 

3.1 EPST Student Program 
Epstu permits students to: 

• learn how equipment works 

• practice trouble-shooting techniques 

To make the practice realistic, video images of 
the actual equipment overlaid with graphics to 
represent the equipment and its current state 
may be used. Alternatively, graphics images 
symbolizing the equipment and its components 
may be used." An example of an EPST graph- 
ics image is shown in Figure 3, p. 11. 

Students use the EPST commands shown in 
Figure 3 to: 

• obtain more detailed views of paits of 

If it is impossible to display video or graphics images, 
EPST will display menus containing data representing 
the current condition of the equipment. 
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Figure 3: Example EPST Screen 

equipment. For example, if students se- 
lect Ignition in Figure 3, the screen will 
be cleared and graphics representing the 
components of the ignition will be dis- 
played. 

• observe displays that reflect the state of 
the equipment. For example, in Figure 3, 
the appearance of the Tachometer, Fuel 
Pressure, Gas Gauge, Manifold Pressure, 
Exhaust Gas Temperature, and Voltmeter 
gauges all reflect the state of the car. 

• make measurements. Students may at- 
tach probes to testpoints and obtain read- 
ings. The probes may be attached either 
to test equipment or to the equipment un- 
der test* 



• change switch settings, 

• replace parts of the equipment, and 

• enter hypotheses. 

Students start the problem-solving session by 
reading the "complaint.** The complaint is a 
written description of one or more symptoms of 
the problem. Tt. objective in EPST is to find 
and replace the faulty part. 

3.2 EPST Authoring 

Three programs, epaut, eptype, and praut are 
used for EPST authoring. 

Epaut is used to: 

• create and edit the EPST databases 

• specify how a piece of equipment is sub- 
divided into components 

• specify how components of the equipment 
work 

• specify how the component parts of the 
equipment are connected together 

• identify positions at which students may 
take measurements (testpoints) 

The information that authors enter using epaut 
determines how the equipment will "work" 
when students use the database. 

Epaut is used to entei assertions such as: 

1. device A is a D flip flop 

2. cable 17 is a RS-232 cable 

3. cable 17 is connected to the terminal's 
connector B 
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•paut is also used to enter rules such as: 



3.3 EPST and Trouble Shooting 



1. if tlf: Clear input is asserted then a D flip 
flop will enter state 0 

2. if the Reset input is asserted then a D flip 
flop will enter state 1 

3. if the clock doesnH rise then a flip flop will 
not change state 

Actual rules follow a standard form. For exam- 
ple, the second rule above has the form: (the 
comments in italics and the rule has been dis- 
played on several lines for clarity). 

If in AnjJStatt The state dotsn't matter 

and 0 The paH is not faulted 

and (R«s«t « Low) Reset i$ asserted 

then 1 The D flip flop will go to the On state 



By entering both assertions and rules, authors 
can describe how something (a piece of equip- 
mtoit, an organization, or an organism) works. 

Eptype is used to edit data types. When authors 
specify a data type they specify the values the 
data may have and how the data will be rep- 
resented in the computer. For example, a data 
type called electricJight could have the values 
on, ofty and broken. 

Praut is used to specify the problems in a piece 
of equipment. When authors specify a problem 
they provide a problem name, solutions, a brief 
description of the problem (the "complaint"), 
and they identify the faulty part and the type 
of fault (a part can usually be faulted in several 
different ways). 



EPST was designed to serve as a replacement of 
the Generalized Maintenance Trainer Simulator 
(GMTS), now known as the Electronic Equip- 
ment Maintenance Trainer (EEMT)[10]. PrdC- 
tice on both GMTS[20] and EEMT[5] was as 
effective as practice on the actual equipment^^^ 

It is difficult to teach people to I ^ good trou- 
bleshooters. Morris and Rouse[15] have sum- 
marized the research on troubleshooting. They 
found that while practice wad useful, theoret- 
ical instruction (p. 513) was ineffective. In 
a later experiment[16] with the PLANT sim- 
ulator, they found that in achieving the pri- 
mary goal of maximizing the PLANT produc- 
tion, the performances of four t^st groups were 
identical. All test groups received minimal in- 
struction. The control group received no addi- 
tional instruction. One group received proce- 
dural instruction, another received instruction 
on the principle, and a third recei\ed instruc- 
tion on both principles and procedures. The 
groups receiving procedural instruction did con- 
trol PLANT in a "more stable manner'' (p. 704). 

It is possible that practice with EPST may help 
students develop better knowledge of the topol- 
ogy of the system and the effects of faults. Be- 
cause the "^npeaxance of parts in EPST is up to 
the authors, authors can present more informa- 
tion to students than is provided by the actual 



"Both GMTS and EEMT use a touchscreen and 
videodisc images of the actual equipment to achieve a 
high degree of physical fidelity. EPST supports the use 
of text and graphics as well as video and consequently 
can be used to achieve a much lower degree of physical 
fidelity. 
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equipment. For example, a partes output may 
be reflected in the color of the part. Sometimes 
this will trivialize the problem. For example, if 
the AND nodes in TASK One[21] with output 0 
were assigned one color and those with output 1 
were given another color, the source of the fault 
would be obvious. However, working or playing 
with such a system might help students develop 
^schema^ or ^ames^ involving the effects of 
fault propagation, particularly if they are given 
the opportunity to insert faults.^^ In a slightly 
more complicated system (a synchronous count- 
ing circuit using gates and JK flip flops), we 
associate '* colors with parts' states. We have 
found that it is not trivial to locate the faults 
in this system, even though the parts' states are 
displayed. We also found that sometimes it is 
impossible to determine the faulted part from 
state data. The display of parts' states relieves 
students of taking measurements and permits 
them to concentrate on the topology and the 
eflects of fault propagation. 



4 Script-Based CAI 

Script-Based CAI (SB CAI) is used to present 
script-based instruction and consequently serves 
the same purpose as other script-based systems 
such as TENCOR, WISE, and PLATO. Like 

'^Mott experimenters, for example, AIlen[l]i have ad- 
dressed the opposite issue, the effects of redudng physi- 
cal fidelity. 

'*In EPST, students have to use the authoring pro- 
gram praut to insert faults. This is to be contrasted 
with the '^y^ aat If* support provided to operators in the 
"aiding" system developed by Yoon and Hammer[24]. In 
this system, operators can deliberately insert faults into 
a simulator to see their effects. 



these other authoring systems, it is used to cre- 
ate "ad hoc" CAI. There is no built-in ipstruc- 
tional strategy. 

Because authors create databases rather than 
lessons with the SBCAI editor, the SBCAI sys- 
tems forms a 4th Generation Language system. 
SBCAI databases are formed from five entities: 

• Primitives. These provide for display of 
materials (graphics, video, text) in win- 
dows. 

• Linear Sequences. Sequences axe used for 
the sequential (no branching) display of 
primitives. 

• Interactions. Interactions present exposi- 
tory material, a question, and appropriate 
local feedback material. 

• Synonym frames. These specify the sy**- 
onyms to be used in answer analysis. 

• Control and Computation frames. These 
specify the flow of control In a lesson, us- 
ing as data information returned from the 
Interactions and other Control and Com- 
putation frames. A Control and Com- 
putation frame may invoke other Control 
and Computation frames as ell as any of 
the other entities. The control language 
is an easy-to-learn subset of Modula-2. 

4.1 SBCAI Student Program 

The S!3CAI student program, try, permits stu- 
dents to use traditional script-based CAI. Stu- 
dents use try by specifying at the command- 
line the database and the entity or entities to 
be used. For example, to view mateiial on the 
negation strategy, "negation** in a database on 
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Interaction: multiple-test 
Question- Answer Type Combinations 

•1* Window - keyboard answer 

2. Line - keyboard answer 

3. Commandline - single answer 

4. Menu - single answer 

5. Multiple Choice - single answer 

6. Matching Question - vector answer 

7. True-False Question - vector answer 

8. Menu - vector answer 

9. Multiple Choice - vector answer 

10. Position - position answer 

Select firom Above 
QUESTION ANSWERS: Select Quit 



problem solving ^^problem," a student would en- 
ter or an instructor would specify in a course 
file: 

try problan nsgation 

The same database can be used for a variety 
of purposes. Because the specific purpose is ac- 
cessed by specifying at the commandline the en- 
tity or entities to use, the same database can be 
used for the pretest, instruction, and posttest. 

4.2 SBCAI Authoring 

Authors use the Lesson and Interaction Editor, 
lie, to edit Interactions, Control and Compu- 
tation frames. Synonym frames, and Sequences, 

4. 2 • 1 Interactions 

An Interaction is used to: 

• present sequences text, graphics, and 
video frames 

• present a question 

• obtain and categorize an answer 

• present an appropriate response sequence 



Figure 4: Question- Answer Type Menu 

ten question-answer types are supported. The 
Question-Answer Type Menu is shown above. 
A predefined structure and the use of menus to 
show what has been entered permit authors to 
maintain an overview of the structure of an In- 
teraction. 



4.2.2 Control and Computation Frames 
Control and Computation frames: 



All interaction with students in SBCAI is 
through Interactions, and each Interaction ob- 
tains the answer to a single question. The 
authoring involves "fill-in- the-slot" operations 
since an Interaction has a predefined struc- 
ture. Although the structure is fixed, au- 
thors are given considerable flexibility because 



• present Interactions 

• present other Control and Computation 
frames 

• execute Synonym frames 

• present Sequenc*^ 

• compute vaxiables used in a lesson 
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Control and Computation frames are edited in 
windows or copied Crom ordinary ASCII text 
jiles. Because Control and Computation frames 
use a programming language, they may be used 
to build a wide variety of lessons ran^ng from 
linear lockstep lessons to lessons offering a sub- 
stantial degree of student control. The program- 
£ j^g language is a subset of Modula-2. 

4.2.3 Synonym Frames 

A Synonym frame is a table of conversion rules 
to be used in analysis of student answers. Sya- 
onj'^m frames free authors from specifying all the 
acceptable synonyms for each keyboard answer. 
For example, if the following synonym frame is 
executed, 

kn kilometer 1.0 
km metar 1000.0 
m metjr 1.0 
in yard 1.0936111 

and in a later Interaction, the anticipated an- 
swer IS J 500 meters, then student answers of 1.5 
km, h'} iloirteter, and 1640 yards will match. 
Sypou>a> i Hi .K-c are edited in windows or they 
ma> he ron:ed 7 om ordinary ASCII text files. 

4.2.. "Ijquences 

Sequences are used to display a linear sequence 
of primitives. All primitives in a Sequence are 
presented to students. When a Sequence is 
edited by an author, a menu like that shown 
in Figure 5, above, is displayed on the screen. 



Sequence: Resistors 





Sequence Instructions 


1. 


Clear Screen Text.Graphics 


2. 


Show.Graphics Symbols for Resistors 


3. 


Show.Window Introduction to Resistors 


4. 


Wait System 


5. 


End of List 




Select from Above 


Seq.: 


Edit Window Line Menu Graphics Video Note 




Clear Prompt Wait Backup Name Try out » 



Figure 5; Sequence Instruction List 



Sequences may be edited with both lie and the 
Sequence Editor, se. 

Text The following four types of text primi- 
tives are supported: 

• label primitives to place labels on the 
screen 

• menu primitives to display a list of items 

• line primitives to display text on a single 
line 

• v/indow primitives to display paragraphs 
of text and other freely formed text 

The four types of text primitive are illustrated 
in Figure 6, above. Text presented in the win- 
dow and menu primitives used in questions can 
be scrolled by students if not all the text can be 
displayed at once. 

Graphics With se and lie, authors can cre- 
ate both graphics primitive and collections of 
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Label Scott: 125 



Afenu 



Line 

i 



Sequence Components 

1. Instructions 

2. Windows 

3. Menus 

- 3 more below -* 
Select firom Above 



This is an example of a line of text across the sere 



Window 



This is text inside a window that may 
be scrolled by a student if not all text 
is viewable. Text in a window is 



Figure 6: Text Primitives 

reusable graphics primitives called graphics li- 
braries. A graphics primitive is illustrated in 
Figure 7, p. 16. 




Figure 7: Graphics Frame 

ited from progressing to the next lesson in the 
sequence until they meet mastery criteria speci- 
fied by the author or instructor. Course is used 
to specify the sequences of lessons, the mastery 
criteria, and student rosters. 



Video The video presented to students is 
specified using video control primitives. Video 
control primitives contain only the information 
that specifies how to display video materials, 
that is, which frames, speed, forward or back- 
ward, etc. The actual video material resides on 
a videodisc. 



5 Instructional Management 

Two programs are used for instructional man- 
agement: cop and course. Cop presents a lin- 
ear sequence of lessons to a set of students. The 
sequence of lessons and the mastery criteria are 
specified in a course file while the student group 
is specified in a roster file. Students are prohib- 



6 Development and Delivery 

CBESS databases may be developed and deliv- 
ered in both the MS-DOS^* (versions 3.1 and 
higher) and Berkeley UNIX^« (versions 4.2 and 
4.3) environments. All CBESS programs run 
in both environments and datafiles created in 
the UNIX environment may be used m the MS- 
DOS environment and vice versa. In addition, 
all CBESS programs except EPST may be run 
on the Novell network in protected mode. 

In the UNIX environment, only a text screen 
is supported and graphics is shown as text. In 

"MS-DOS is a Trademark of Microsoft Inc. 
"UNIX is a rfg!?tered trademark of ATkT Bdl 
Laboratories. 
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the MS-DOS enviromnenti a range of display 
adapters are supported (mda, hercules, cgahi, 
cga80| cgalowi cga40, ega) along with two in* 
put devices (Mousesystems mouse and Sum- 
magraphics di^tizer). Three brands (Hitachi, 
Sony, and Pioneer) of videodisc are supported. 
A file that is usually called cbess.cfg^^ speci- 
fies the devices to use. CBESS supports three 
logical screens: author, student, and overlay. 
Different display adapters can be bound to the 
lo^cal screens; material specified for a particu- 
lar logical screen will be displayed on the device 
connected to the display adapter to which it is 
bound. The CBESS programs were designed to 
run on systems with hard disks* They do not 
run as well on floppy disk systems.^* 
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